Stochastic Thermodynamics for Inhomogeneous Media 
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A unifying framework for the thermodynamics of fluctuating systems with Fokker-Planck dynamics 
has been developed by Seifert using the notion of stochastic entropy. Here we consider the extension 
of this formalism to the case of inhomogeneous media, where the diffusivity D — D(x) is state- 
dependent (multiplicative noise) and the usual fluctuation theorems can be violated. We introduce 
to this effect the concept of relative stochastic entropy, and use it to generalize (i) the maximum- 
entropy principle for the Gibbs canonical ensemble, (ii) the second law of thermodynamics and {Hi) 
Seifert's integral fluctuation theorems. Our "relative stochastic thermodynamics" can be used e.g. 
to describe the stochastic motion of colloidal particles dragged in viscous fluids with space-dependent 
viscosity and/or temperature. 
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Introduction. While classical thermodynamics was 
originally designed for macroscopic systems described by 
a handful of state variables, it is now well understood that 
concepts such as energy and entropy are also relevant 
to mesoscopic non-equilibrium processes where thermal 
fluctuations play an essential role [l], Q . Following this 
line of thought, a number of fluctuation theorems (FT) 
have been derived in the last decade [1H3 (see for a 
up-to-date review), and their relevance to experimental 
setups such as the dragging of colloidal particles in vis- 
cous fluids Q demonstrated by several authors 0-0] ■ The 
key elements of these theorems are (i) a bath at thermal 
equilibrium, (ii) a mesoscopic system with (determinis- 
tic or stochastic) dynamics and (Hi) a suitably defined, 
protocol-dependent notion of entropy for the system and 
its surrounding medium. Generally speaking, one then 
shows that 0] 



(e-*°) = 1, 



(1) 



where As is the total entropy variation along the pro- 
tocol, and the brackets denote an average over non- 
equilibrium fluctuations. This identity implies in par- 
ticular (As) > 0, which is the mesoscopic version of the 
second law of (non-equilibrium) thermodynamics. 

The integral FT ([1]) has been obtained by Seifert in 
the context of Fokker-Planck dynamics JlO|. Elaborating 
on the work of Sekimoto 11 1 , Crooks |5| and Qian 12 1 , 
he considers the overdamped motion of a particle in a 
thermal bath (a viscous fluid), and defines a trajectory- 
dependent entropy as the sum of two terms: the "system 
entropy" s s measuring the uncertainty on the instanta- 
neous position of the particle, and the "medium entropy" 
s m associated to the heat dissipated in the medium as an 



external driving force is applied to the particle. In this 
setup, the total entropy s = s s + s m can be showed to 
satisfy the relation ([T]), where the average is over Brown- 
ian trajectories, for arbitrary initial conditions and time- 
dependent driving. 

One key assumption underlying this result is that the 
medium be homogeneous, so that the diffusivity D is con- 
stant. The purpose of this paper is to address the fate 
of stochastic thermodynamics when this assumption is 
dropped. Inspired by our recent discussion of the "ge- 
ometric ratchet effect" [Hj], where the FT {TJ is vio- 
lated because the free equilibrium particle distribution p* 
(that is, without external driving) is inhomogeneous, we 
argue that the suitable notion of entropy for inhomoge- 
neous media is not the standard Gibbs form — J dVphip, 
but rather the relative entropy of p with respect to p . 
With this key concept on hand, we can generalize both 
the canonical equilibrium distribution and the Seifert 
integral FT for non-equilibrium processes to inhomoge- 
neous media. 

The use of relative entropy is certainly not new to this 
work. Originally introduced in the context of mathemat- 
ical statistics 14j . relative entropy has been used as a 
useful tool in many contexts, from quantum information 
(ljj to black hole physics [lj|. What we show here is that, 
in inhomogeneous media, relative entropy is not merely 
a useful mathematical tool; it is the thermodynamic en- 
tropy driving irreversible processes. The author did not 
find this claim spelled out explicitly in the literature, al- 
though hints to this effect can be found in the early works 
17 1 and 18 1, and more recently in HI, 2(|. In particu- 
lar, our use of the concept of relative entropy is not to 
be confused with the "phase-space perspective" of Kawai, 



2 



Parrondo and Van den Broeck [2lj, as will be explained 
in the conclusion. 

Inhomogeneous Fokker-Planck dynamics. Consider 
an overdamped particle with mobility n(x) diffusing in 
an inhomogeneous thermal bath, subject to a protocol- 
dependent force [Io[ 



F(x,X) = -WV(x,X)+f(x,X). 



(2) 



Here the "protocol" X(t) is an external control parameter 
varied continuously on the time interval i, < t < tf, 
V(x, X) is a local conservative potential and f{x, A) is a 
force applied directly to the particle. The trajectory x(t) 
of the particle is governed by the Langevin equation 



x = n(x)F{x, X) + £(x), 



(3) 



where Ci x ) i s a normalized Gaussian white noise with lo- 
cal covariance (C(x,t)( j (x,t')} = 2D(x)S ij 6(t - t'). Wc 
assume that the local diffusivity D(x) is related to the 
local mobility /i(a;) and temperature T(x) according to 
Einstein's relation D(x) = fj,(x)T(x). We leave the di- 
mension of the configuration space d unspecified. 

As is well known 22j , the Langevin equation ([3]) is not 
well defined as such because of a discretization ambigu- 
ity in the definition of the velocity x. Depending on the 
actual nature of the medium's inhomogeneity, this ambi- 
guity results in one of several inequivalcnt Fokker-Planck 
equations for the probability density p. In this paper 
we focus on those systems where the microscopic physics 
dictates to interpret ([3]) in the Ito sense, 



dx = n(x)F(x, X)dt + v / 2D(x)dW, (4) 
or equivalently by 



o dx = (n(x)F(x, A) - VD)dt + ^2D(x) o dW (5) 

where o d is the Stratonovich stochastic differential and 
W the standard <i-dimensional Wiener process. Both 
equations (T5]) and (O correspond to the Fokker-Planck 
equation 

d t p + V • j = (6) 

with the probability current 

j=fiFp-V(D P ). (7) 

Our motivation for considering this case in detail is 
because its violates the Seifert FT — and indeed any state- 
ment to the effect that "the entropy of an isolated sys- 
tem at local equilibrium can never decrease" . This is 



due to the following fact: the equilibrium distribution 
for (J6j) is inhomogeneous also in the absence of any ex- 
ternal forcing (F = 0). Instead, the free equilibrium 
distribution p* z satisfies p* (x) oc D(x)~ 1 . This implies 
for instance that, when D(x) has a trap-like shape (viz. 
grows monotonously about a global minimum), stochastic 
dynamics can result in "anti-diffusion" : initially spread 
Brownian particles will spontaneously concentrate at the 
bottom of the trap without any external force, hence 
(As) < 0; see Fig. [T]for an explicit example of this effect. 



Let us emphasize that systems where transport is 
well described by equations ((3]) and (O, and in partic- 
ular where the free equilibria p* are not constant, are 
not mathematical abstractions: they do exist in nature. 
Among such systems, we can mention fusion plasmas 25j . 
thermodiffusion at certain values of the Soret coefficient 
EfiL or more simply fluid mixtures with variable vis- 
Considering the Einstein relation D 



cosity 



fj,T, 



we see that the presence of temperature gradients, as in 
thermodiffusion, is not the only source of inhomogene- 
ity: a mobility gradient at fixed temperature will result 
in V-D ^ as well. The fluid system of [23[ is an in- 
stance of this second possibility. This case is particularly 
interesting, for it shows that with a viscosity profile de- 
creasing monotonously about a maximum, Brownian par- 
ticles can self-organize (viz. decrease their mean entropy) 
without any heat being exchanged with the environment; 
see 13( for an in-depth discussion of this surprising phe- 
nomenon. 2 

Relative stochastic entropy. What this "geometric 
ratchet effect" — as we proposed to call it in |13[ — shows 
is that the ordinary Gibbs entropy of the particle distri- 
bution is not the relevant quantity to describe dissipative 



processes in inhomogeneous media. As argued in [13 1 
(and already understood in 17, IH), one should use in- 
stead the relative entropy of p with respect to the free 



2 Another case where JBJl with (0 naturally arises is in general 
relativity. Indeed, the diffusion equation for a Brownian particle 
in local equilibrium with a fluid in hydrostatic equilibrium in a 
gravitational field is |27|1 



dt = D Q A(N P ), 



(8) 



1 Rather than for instance j = fiFp — -DVp, as in [24 



where N is the lapse function in the rest frame of the fluid and 
-Do is the proper (constant) diffusivity. This is of course the 
Fokker-Planck equation (J6j with F = 0. To our knowledge, this 
connection between inhomogeneous diffusion and general relativ- 
ity is the first realization of the "analogue gravity" paradigm [2g| | 
in the realm of dissipative physics. 
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FIG. 1: Numerical solution of the one-dimensional FP equation © with F — and Neumann boundary conditions, at three 
times to < fi < ti (left to right). The dashed curve (left axis) is the local diffusivity D(x) normalized to its maximal value; the 
thick curve (right axis) are the probability densities p(ti,x), with x in arbitrary units. The amplitude of variation of D(x) is 
consistent with the fluid experiment of [23]. The conventional Gibbs entropy manifestly decreases in this setup, see also [la ]. 



(F = 0) equilibrium p* , namely 



K{p\\ P * ) 



pin — dv, 

P0 



(9) 



where dv is the volume element. This quantity, also 
known as the Kuilback-Lciblcr divergence 14| . measures 
the informational "distance" between the instantaneous 
distribution p and the equilibrium p* . 

That K{p \ \p*0) is a suitable measure of irreversibility 
can be seen by checking that, unlike the standard Gibbs- 
like entropy — J dV plnp, the relative entropy K(p || p* ) 
can never decrease 3 in a free diffusion process: starting 
from the driftless Fokker-Planck equation dtp = A (Dp), 



one checks easily that [171 ll 



dK(p\\p ) 
dt 



Dp 



dv > 0. 



(10) 



Of course, the standard Gibbs entropy is a particular case 
of relative entropy, namely the relative entropy with re- 
spect to a uniform prior. 

Relative canonical ensemble. The first implication of 
the fact the free equilibrium distribution p* is inhomo- 
geneous is the modification of the canonical ensemble for 
thermal equilibrium (/ = 0, T = const). Indeed, adapt- 
ing Jaynes' informational reasoning p9j to this setup, one 
is led to the principle of maximum relative entropy: the 



3 Incidentally, the first use of relative entropy to resolve an appar- 
ent violation of the second law of thermodynamics was perhaps 
by Gibbs himself: adding a term In TV! to the entropy of a gas of 
indiscernible particles is really considering the entropy relative to 
the equilibrium distribution <x 1/JV! over the redundant N- 
particlc phase space (here Ti is the 1-particle phase space). 



equilibrium canonical distribution p* in a given poten- 
tial is the one maximizing the entropy relative to the free 
equilibrium p* , subject to the mean energy constraint 
J dxp*V = const. Denoting as usual /3 = 1/T the cor- 
responding Lagrange multiplier leads to the variational 
problem 

max (— Jp In dv + (3 J p V dv^j , (11) 
which is equivalent to 



max ( — / p lnp dv + (3 I pV dv 



(12) 



where V = V — hip /j3 plays the role of a generalized 
potential (H)]. 4 The solution of this variational problem 
defines the relative canonical ensemble, 



p' oc e 



P0 e 



-pv 



(13) 



which is the suitable one for thermal equilibrium in inho- 
mogencous media. 

Second law of thermodynamics. Let us now come back 
to the problem of driven diffusion. As stressed by Seifert 
[lbT ]. the entropy variation of stochastic systems splits in 
two terms: the variation of the system entropy As s , as- 
sociated to the uncertainty on the instantaneous posi- 
tion x(t) of the system, and the entropy dissipated in 
the medium As m , associated to heat transfers between 
the work received by the system and the surrounding 
medium. In the context of Fokker-Planck dynamics, these 



4 The gradient Vlnp^//3 is of course the same as the Stratonovich 
correction in equation f5T > . 
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quantities can be denned for a single trajectory x(t) (Io| . 
Following our discussion of relative entropy, we define the 
relative system entropy by 



s' s (t) = -In 



p(x(t),t) 



(14) 



We define furthermore the dissipated entropy in the 
medium by the Stratonovich integral 



As. 



11 F(x(s),\(s)) 



>dx(s). (15) 



/to T(x(s)) 

The total relative stochastic entropy is then the sum 

s' = s' s + s m . (16) 

Its variation ods'(t) along the stochastic trajectory x(t) 
is given by 

ods ' { t) = -^-dt- V(P/P * ] ■ o dx(t) + g • o dx(t) , (17) 
1 ' P P/P* T v h v ' 

with each term is evaluated at x(t). Using <[7|) and the 
Einstein relation, this gives 



o ds' 



d t p 



dt 



Dp 



o dx. 



(18) 



which is the generalization of Scifert's "first central re- 
sult" in fioj to inhomogeneous media. It provides an 
explicit formula for the entropy production along a single 
stochastic trajectory. Paraphrasing , we can then use 
(|18[) to obtain the mean total entropy production rate 



~dt 



dK(p\\p* ) 
dt 



> 0. 



(19) 



This inequality is the proper statement of the second 
law of non-equilibrium thermodynamics in the inhomo- 
geneous context. Again, its validity relies crucially on 
the use of the relative entropy of the particle with re- 
spect to their free equilibrium distribution, and not the 
standard Gibbs expression. 

Relative fluctuation theorem. We now move on to con- 
sider the relative version of Seifert's FT. Following the 
standard procedure , we proceed by computing the ra- 
tio of the probability of a given trajectory x(t) starting 
at xq and ending at x\ to that of the reversed trajec- 
tory x(t) = x(t — t) driven by the reversed protocol 
\(t) = \(t — t); the integral FT then follows from a suit- 
able weighting of the initial position and final position of 
the path. 



In the standard setup, the probabilities P[x(t)} and 
P\x{t)\ of a path x(t) and its reverse x(t) satisfy 



In 



P[x(t)\ 



(20) 



i.e. the irreversibility of a path is measured by the en- 
tropy dissipated in the medium; in the limit where F = 0, 
this gives P[x(t)} = P[x(t)}. In the inhomogeneous media 
considered in this paper, this it is clear that this relation 
cannot hold anymore: a path ending at point where the 
free equilibrium probability p* is larger must be favored 
over the reversed path. 

Indeed, using the generalized Onsager-Machlup func- 



tion 



us 



(x — u(x)F(x, A) — h(x)) , , , „ 

£i,i,A=- An r UJ -+f(x) 21 

ADyx) 

where h{x) = (d/2 — l)Vfl(i:) and f(x) is a function of 
x only which we do not need to specify, we can write 
the path probability density ir\x(t)] with respect to the 
generalized Wiener measure [22j 



V[x(t)] 



N 



N-l 

lim [ (AtttD{x 



n=0 



-d/2 



dv(x n ) (22) 



as 



L(x(t),x(t))dt ) 8(x(0) - x 



ir[x(t)) = exp 

(23) 

Here r = (ti — t )/N, x n = x(to + jit) and x is the time- 
derivative of a smooth trajectory approximating x{t). 
Hence 



In 



P[x(t)} 



"2 n D(x ) 



P[x{t)\ 

(L(x(t),x(t),\(t)) - L(x(t),x(t),X(t))) dt (24) 



Evaluating the integral explicitly and using again p* oc 
D^ 1 , we arrive at 



In 



P[x{t)\ 



As m (r) + In 



pU?i) 
p%{x y 



(25) 



Note the extra term with respect to the homogeneous 
case [loj . 

To derive the corresponding integral FT, we weigh the 
starting point xq by the initial condition p(xq, to) and the 
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final point xo = x\ by the evolved distribution p(xi,t\) 
and form the ratio 



i? = ln 



P[x(t)}p(x ,t ) 
P[x(t)]p(xi,ti)' 



(26) 



According to (|25[) . R is nothing but the variation of the 
total relative stochastic entropy, viz. R = As'. We can 
then apply the classic identities 



(e- R )= I V[x{t)}TT[x(t)} Po {x ,to)e- R (27) 
V[x(t)]7r[x(t)]p(x ,t 1 ) = l, (28) 



to obtain 



<e- As ') = 1. 



(29) 



This relation is the main result of this work. Note that 
choosing a more general weight pi(xi) for the final point 
xi (indeed any probability density) would have led in- 
stead to the generalization of Seifert's "unifying" FT [nil ] 



-As m PiQi) P*ss( x o) 
P*ei( x i) P(xo,t ) 



(30) 



Conclusion. We have extended the framework of 
stochastic thermodynamics to state-dependent diffusions, 
with an emphasis on the notion of relative stochastic en- 
tropy. We have showed that the latter is the general 
measure of irreversibility for inhomogeneous media, and 
not the ordinary Gibbs entropy. 

It is important to contrast our use of this concept from 
the one made in [2lj |: while Kawai et al. consider the 
relative entropy K(p || p) of the probabilities p and p for 
the forward and backward processes, our relative stochas- 
tic entropy s' s involves the forward process and the free 
equilibrium state. This is conceptually very different; in 
particular, the framework of [2l| does not apply to in- 
homogeneous media. A much closer application of this 
concept is in [20[ and [l9| , where the entropy of a state rel- 
ative to the corresponding equilibrium state is discussed; 
the main difference with the present work is that, in both 
papers, the gradients of the equilibrium distributions are 
always due to energy variations. Here we also considered 
VD as a source of inhomogeneity of p* . 

Let us emphasize that altough we focused on the Ito 
interpretation (j4|) of the Langevin equation, our analysis 
is not restricted to this case: in a setup where ((3]) has a 
homogeneous free equilibrium, our results reduce to the 
standard ones, with relative entropy coinciding with or- 
dinary entropy 24j. We also note that our framework 



can be immediately adapted to Markovian dynamics on 
a discrete state space, as in fioj . 

To put our extended framework to test, one could for 
instance repeat the famous colloidal particle dragging ex- 
periment [Tf, but now within a fluid with varying viscos- 
ity, as in [2 31 ] . 
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